The Impact of Test Case Prioritization on Test Coverage versus Defects Found
نویسندگان
چکیده
Prior studies demonstrate the importance of the relationship between code coverage and defects found to determine the effectiveness of test inputs. The variation of defect coverage with code coverage has been studied for a fixed execution sequence of test cases. We conducted an experiment to evaluate hypotheses expressed in two research questions. The first question addresses the relationship between defect coverage with code coverage for different execution sequences of test cases. The second research question evaluates the effectiveness and expensiveness of employing the prioritization techniques. The study confirms that altering the test cases execution order can affect the relationship between the code coverage and defects found. The results show that the optimal prioritization outperforms the st-total and the random prioritization.
منابع مشابه
Test Case Generation and Prioritization Based on Uml Behavioral Models
Test case prioritization (TCP) techniques have been proven to be beneficial for improving testing activities. Prioritized test suites are found using different techniques of prioritization. While code coverage based prioritization techniques are found to be used by most scholars, test case prioritization based on UML behavioral models has not been given much attention so far. We propose a novel...
متن کاملA Comparison of Coverage-Based and Distribution-Based Techniques for Filtering and Prioritizing Test Cases
This paper presents an empirical comparison of four different techniques for filtering large test suites: test suite minimization, prioritization by additional coverage, cluster filtering with one-per-cluster sampling, and failure pursuit sampling. The first two techniques are based on selecting subsets that maximize code coverage as quickly as possible, while the latter two are based on analyz...
متن کاملPrioritization of Test Cases scenarios derived from UML Diagrams
Test Case Prioritization (TCP) is setting priority to each and every test case from test case suit and executes those test cases in descending order. The proposed generic tool will first generate test cases from UML diagram sequence diagram and prioritize them on basis of following criteria's: prioritization on depending upon depth, prioritization on dependency of number of parameters, pri...
متن کاملTest case prioritization for regression testing using immune operator
Regression testing is a time consuming, costly process of re-running existing test cases. As software evolves, the regression test suite grows in size. Test case prioritization techniques help by ordering test cases such that at least the test cases which cover the changes made in the software are executed amidst resource and time constraints. Genetic Algorithm (GA) has been widely used for tes...
متن کاملSimilarity-based regression test case prioritization
With the continuous evolution of software systems, test suites often grow very large. Rerunning all test cases may be impractical in regression testing under limited resources. Coverage-based test case prioritization techniques have been proposed to improve the effectiveness of regression testing. The original test suite often contains some test cases which are designed for exercising productio...
متن کامل